Learning and Production of Movement Sequences: Behavioral, Neurophysiological, and Modeling Perspectives

A growing wave of behavioral studies, using a wide variety of paradigms that were introduced or greatly refined in recent years, has generated a new wealth of parametric observations about serial order behavior. What was a mere trickle of neurophysiological studies has grown to a more steady stream of probes of neural sites and mechanisms underlying sequential behavior. Moreover, simulation models of serial behavior generation have begun to open a channel to link cellular dynamics with cognitive and behavioral dynamics. Here we summarize the major results from prominent sequence learning and performance tasks, namely immediate serial recall, typing, 2XN, discrete sequence production, and serial reaction time. These populate a continuum from higher to lower degrees of internal control of sequential organization. The main movement classes covered are speech and keypressing, both involving small amplitude movements that are very amenable to parametric study. A brief synopsis of classes of serial order models, vis-à-vis the detailing of major effects found in the behavioral data, leads to a focus on competitive queuing (CQ) models. Recently, the many behavioral predictive successes of CQ models have been joined by successful prediction of distinctively patterend electrophysiological recordings in prefrontal cortex, wherein parallel activation dynamics of multiple neural ensembles strikingly matches the parallel dynamics predicted by CQ theory. An extended CQ simulation model-the N-STREAMS neural network model-is then examined to highlight issues in ongoing attemptes to accomodate a broader range of behavioral and neurophysiological data within a CQ-consistent theory. Important contemporary issues such as the nature of working memory representations for sequential behavior, and the development and role of chunks in hierarchial control are prominent throughout.Defense Advanced Research Projects Agency/Office of Naval Research (N00014-95-1-0409); National Institute of Mental Health (R01 DC02852

Effects of Dopamine Medication on Sequence Learning with Stochastic Feedback in Parkinson's Disease

A growing body of evidence suggests that the midbrain dopamine system plays a key role in reinforcement learning and disruption of the midbrain dopamine system in Parkinson's disease (PD) may lead to deficits on tasks that require learning from feedback. We examined how changes in dopamine levels (“ON” and “OFF” their dopamine medication) affect sequence learning from stochastic positive and negative feedback using Bayesian reinforcement learning models. We found deficits in sequence learning in patients with PD when they were “ON” and “OFF” medication relative to healthy controls, but smaller differences between patients “OFF” and “ON”. The deficits were mainly due to decreased learning from positive feedback, although across all participant groups learning was more strongly associated with positive than negative feedback in our task. The learning in our task is likely mediated by the relatively depleted dorsal striatum and not the relatively intact ventral striatum. Therefore, the changes we see in our task may be due to a strong loss of phasic dopamine signals in the dorsal striatum in PD

Jumping to conclusions in schizophrenia

Simon L Evans,1 Bruno B Averbeck,2 Nicholas Furl31School of Psychology, University of Sussex, Brighton, East Sussex, UK; 2Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA; 3Department of Psychology, Royal Holloway, University of London, Egham, Surrey, UKAbstract: Schizophrenia is a mental disorder associated with a variety of symptoms, including hallucinations, delusions, social withdrawal, and cognitive dysfunction. Impairments on decision-making tasks are routinely reported: evidence points to a particular deficit in learning from and revising behavior following feedback. In addition, patients tend to make hasty decisions when probabilistic judgments are required. This is known as “jumping to conclusions” (JTC) and has typically been demonstrated by presenting participants with colored beads drawn from one of two “urns” until they claim to be sure which urn the beads are being drawn from (the proportions of colors vary in each urn). Patients tend to make early decisions on this task, and there is evidence to suggest that a hasty decision-making style might be linked to delusion formation and thus be of clinical relevance. Various accounts have been proposed regarding what underlies this behavior. In this review, we briefly introduce the disorder and the decision-making deficits associated with it. We then explore the evidence for each account of JTC in the context of a wider decision-making deficit and then go on to summarize work exploring JTC in healthy controls using pharmacological manipulations and functional imaging. Finally, we assess whether JTC might have a role in therapy.Keywords: ketamine, decision making, delusions, fMRI, urn tas

A Selective Emotional Decision-Making Bias Elicited by Facial Expressions

Emotional and social information can sway otherwise rational decisions. For example, when participants decide between two faces that are probabilistically rewarded, they make biased choices that favor smiling relative to angry faces. This bias may arise because facial expressions evoke positive and negative emotional responses, which in turn may motivate social approach and avoidance. We tested a wide range of pictures that evoke emotions or convey social information, including animals, words, foods, a variety of scenes, and faces differing in trustworthiness or attractiveness, but we found only facial expressions biased decisions. Our results extend brain imaging and pharmacological findings, which suggest that a brain mechanism supporting social interaction may be involved. Facial expressions appear to exert special influence over this social interaction mechanism, one capable of biasing otherwise rational choices. These results illustrate that only specific types of emotional experiences can best sway our choices

Sequence Learning Under Uncertainty in Children: Self-Reflection vs. Self-Assertion

We know that stochastic feedback impairs children’s associative stimulus–response (S–R) learning (Crone et al., 2004a; Eppinger et al., 2009), but the impact of stochastic feedback on sequence learning that involves deductive reasoning has not been not tested so far. In the current study, 8- to 11-year-old children (N = 171) learned a sequence of four left and right button presses, LLRR, RRLL, LRLR, RLRL, LRRL, and RLLR, which needed to be deduced from feedback because no directional cues were given. One group of children experienced consistent feedback only (deterministic feedback, 100% correct). In this condition, green feedback on the screen indicated that the children had been right when they were right, and red feedback indicated that the children had been wrong when they were wrong. Another group of children experienced inconsistent feedback (stochastic feedback, 85% correct, 15% false), where in some trials, green feedback on the screen could signal that children were right when in fact they were wrong, and red feedback could indicate that they were wrong when in fact they had been right. Independently of age, children’s sequence learning in the stochastic condition was initially much lower than in the deterministic condition, but increased gradually and improved with practice. Responses toward positive vs. negative feedback varied with age. Children were increasingly able to understand that they could have been wrong when feedback indicated they were right (self-reflection), but they remained unable to understand that they could have been right when feedback indicated they were wrong (self-assertion)

Stimulating learning: A functional MRI and behavioral investigation of the effects of transcranial direct current stimulation on stochastic learning in schizophrenia

Transcranial direct current stimulation (tDCS) of the medial prefrontal cortex (mPFC) is under clinical investigation as a treatment for cognitive deficits. We investigate the effects of tDCS over the mPFC on performance SSLT in individuals with schizophrenia, and the underlying neurophysiological effect in regions associated with learning values and stimulus-outcome relationships. In this parallel-design double-blind pilot study, 49 individuals with schizophrenia, of whom 28 completed a fMRI, were randomized into active or sham tDCS stimulation groups. Subjects participated in 4 days of SSLT training (days 1, 2, 14, 56) with tDCS applied at day-1, and during a concurrent MRI scan at day-14. The SSLT demonstrated a significant mean difference in performance in the tDCS treatment group: at day-2 and at day-56. Active tDCS was associated with increased insular activity, and reduced amygdala activation. tDCS may offer an important novel approach to modulating brain networks to ameliorate cognitive deficits in schizophrenia, with this study being the first to show a longer-term effect on SSLT

Salivary cortisol levels in Parkinson's disease and its correlation to risk behaviour

Objective To investigate salivary cortisol samples in patients with Parkinson's disease (PD) with and without impulsive compulsive behaviours (ICB) during a risk task.Methods Salivary cortisol levels were measured in 13 PD patients without ICB (PD-ICB) and in 15 PD patients with ICB (PD+ICB) before, after medication and throughout the day, and were compared with results with 14 healthy controls. All participants also performed a gambling task to assess risk taking behaviour.Results Significantly higher diurnal cortisol levels were found in the PD-ICB group compared with healthy controls but no differences were seen between the PD+ICB and the control group. Increased cortisol levels were significantly correlated with increased risk taking in PD+ICB patients but no interaction was found in the PD-ICB group.Conclusions The findings are in keeping with previous studies which have linked low cortisol levels with antisocial behaviour. The higher cortisol levels during the risk task in the PD+ICB group are consistent with reports in pathological gamblers during gambling and addicts during drug abuse. The results support the hypothesis that cortisol plays an important role in risk taking in ICBs

Impulsivity in Parkinson’s disease is associated with alterations in affective and sensorimotor striatal networks

A subset of patients with Parkinson’s disease (PD) experiences problems with impulse control, characterized by a loss of voluntary control over impulses, drives, or temptations regarding excessive hedonic behavior. The present study aimed to better understand the neural basis of such impulse control disorders (ICDs) in PD. We collected resting-state functional connectivity and structural MRI data from 21 PD patients with ICDs and 30 patients without such disorders. To assess impulsivity, all patients completed the Barratt Impulsiveness Scale and performed an information-gathering task. MRI results demonstrated substantial differences in neural characteristics between PD patients with and without ICDs. Results showed that impulsivity was linked to alterations in affective basal ganglia circuitries. Specifically, reduced frontal–striatal connectivity and GPe volume were associated with more impulsivity. We suggest that these changes affect decision making and result in a preference for risky or inappropriate actions. Results further showed that impulsivity was linked to alterations in sensorimotor striatal networks. Enhanced connectivity within this network and larger putamen volume were associated with more impulsivity. We propose that these changes affect sensorimotor processing such that patients have a greater propensity to act. Our findings suggest that the two mechanisms jointly contribute to impulsive behaviors in PD

The importance of pro-social processing, and ameliorating dysfunction in schizophrenia. An FMRI study of oxytocin

Schizophrenia is often a severe and debilitating mental illness, frequently associated with impairments in social cognition that hinder individuals' abilities to relate to others and integrate effectively in society. Oxytocin has emerged as a putative therapeutic agent for treating social deficits in schizophrenia, but the mode of action remains unclear. This placebo-controlled crossover study aimed to elucidate the neural underpinnings of oxytocin administration in patients with schizophrenia. 20 patients with schizophrenia were examined using functional magnetic resonance imaging under oxytocin (40 IU) or placebo nasal spray. Participants performed a stochastically rewarded decision-making task that incorporated elements of social valence provided by different facial expressions, i.e. happy, angry and neutral. Oxytocin attenuated the normal bias in selecting the happy face accompanied by reduced activation in a network of brain regions that support mentalising, processing of facial emotion, salience, aversion, uncertainty and ambiguity in social stimuli, including amygdala, temporo-parietal junction, posterior cingulate cortex, precuneus and insula. These pro-social effects may contribute to the facilitation of social engagement and social interactions in patients with schizophrenia and warrant further investigation in future clinical trials for social cognitive impairments in schizophrenia